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(54) Method for encoding a digital image and coder 



(57) The invention describes a method for coding 
residue data that are separated from a highly com- 
pressed base layer of data by taking a difference be- 



tween the original and the reconstructed data signal us- 
ing the residual signal with N bits in binary format and 
form N bit-planes within the bit planes are sorted a de- 
fined criteria. 
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Description 

[0001] The present invention is related to the field of 
digital image processing and more particularly to a 
method for decoding and / or encoding digital images. 5 
[0002] The storage of compressed streams of data 
and their transmission over heterogeneous and packed- 
based networks to end users connected with various 
physical links is greatly alleviated when the stream is 
scaleable temporary, spatially and qualitatively for video 10 
streams and qualitatively for voice or audio streams. As- 
suming these streams fulfill the later properties the prob- 
lem consists in building hierarchical flows of packets 
such as each element of the whole transmission chain 
can first identify this hierarchy and secondly decide is 
which flow of packets of which single packet can be ne- 
glected without compromising the global quality of the 
service. The quality of the service at each end user is in 
that case independent from the others There is a strong 
link between the structure of the bit stream, the coding 20 
algorithm and the packet ization process. The problem 
is building the optimal hierarchy for data packets. 
[0003] The invention gives a solution with a method 
for coding residue data that are separated from a highly 
compressed base layer of data by taking a reference 2s 
from the original and reconstructed coefficients of a 
mathematical transformation of data, , using the residue 
signal with N bits in binary format and form N bit -planes, 
characterized in that the bit planes are sorted by a de- 
fined criteria. Every kind of mathematical transformation 30 
can be used as e.a. a discrete cosine transform, a dis- 
crete wavelet transform or fast Fourier transform. 
[0004] An example is shown in the figures and de- 
scribed in the following description. 

35 

Fig. 1 shows the taking of residue between original 
and lower boundary point of quantization bin 
Fig. 2 Scheme of coding 
Fig. 3 Bit planes 

Fig. 4 Application example 40 
Fig. 5 Bit-plane coder. 

[0005] Qualitative capable streams are usually struc- 
tured into a base layer and at least one enhancement 
layer. This is for example known from the proposals for 45 
a MPEG-4 Standard published Dec. 1998 "Coding of 
moving pictures and associated audio" in the Internet. 
The related coding scheme produces a highly com- 
pressed base layer which is known in the proposal as 
visual IS layer. The residual information is used to pro- so 
duce either several enhancement layers or only one pro- 
gressive enhancement layer. In this paper a method of 
"Fine Granularity Scalability" FGS for natural video sig- 
nals is proposed which includes a description of the syn- 
tax and encoding/ decoding procedures for this layer. In 55 
this paper a coding scheme for bit plane encoding is pro- 
posed ordering the bit-planes in bit-plane from the most 
significant bit (MSB) to the bit-plane of the less signifi- 



cant bit LSB). 

[0006] The task of the invention is to use the same 
bandwidth to optimize the signal to noise ratio of the 
transmitted data and the quality of the signal. To solve 
this problem the bit-plane coding scheme is modified so 
that a statistic table is built up to give a different order 
of a bit-planes for getting better quality at the same 
bandwidth of transmission. The inventional proposal 
has the advantage that for the same bandwidth the qual- 
ity of the information is enhanced. The method can eas- 
ily be implemented as a function in the network inde- 
pendent from the coder itself. Following the MPEG 2 
Standard which is related to the ISO/I EC 13818 Stand- 
ard a special algorithm is defined which only fixes the 
syntax and the semantic of the bit stream and in partic- 
ular the functional elements of the decoder. The basis 
of the coding is a hierarchy in form of six layers: se- 
quence layer, group of pictures layer, picture layer, slice 
layer, macroblock layer and block layer. A MPEG 2 im- 
age is coded first by a block transformation and a quan- 
tization using a discrete cosinus transformation scheme 
for the transformation. Afterwards a run length coding 
and a variable length coding simplifies the data to trans- 
mit. MPEG 2 uses no bit-plane sorting method. The bit- 
plane coding takes place after the quantization step but 
adding the computation of the residual data. On the en- 
coder side the coding technique includes the following 
operations: 

Taking a residue between the original DCT coefficient 
and a reference point determined by a quantized DCT 
coefficient. 

Bit-plane encoding of the absolute value of the residual 
signal. 

[0007] Selective encoding of the signs of the residue 
signal. 

[0008] For taking the residue the reference mode 
method is taken. In the reference method the difference 
between the original and the lower boundary point of the 
quantization bin except the 0 bin as shown in Fig. 1 is 
taken. In the reference method the residue from the pos- 
itive side remains positive and the residue from the neg- 
ative side remains negative, taking the residue is equiv- 
alent to moving the origin to the reference point. There- 
fore the probability of the residue becomes the one 
shown in the lower half of Fig. 1 which preserves the 
shape of the original non uniform distribution. The bit- 
plane coding is started for the residual information which 
is divided from the basis data stream. 
[0009] Fig. 2 shows a scheme of the data stream of a 
source data, e.a. a 8 x 8 matrix which is transformed by 
a discrete cosinus transformation DCT then quantisized 
in a quantisizer 2 and coded by entropy encoder 3, e.g. 
run length coding RLC and a variable length coding 
VLC. The basis data layer is packetized in a packetizer. 
The residual information which is divided from the main 
stream after the discrete cosinus transformation 2 is 
connected to a inverse quantisizer 2a and then handled 
in a bit-plane coding scheme. The result is sent to the 
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packetizer, too. 

The packetiser is not mandatory for the inventional cod- 
ing scheme. After taking residues of all DCT- coefficient 
inaSxBblock bit-plane is used to code the absolute 
values of the residue. The major conceptual difference s 
between the bit coding method and run length coding 
method is that bit-plane coding method considers each 
absolute residue value as a binary number of several 
bits instead of a decimal integer of a certain value. The 
64 absolute values of the residue signal are ordered into io 
a one dimensional array. The bit-plane coding method 
can be described as a following procedure: Find the 
maximum value of all the absolute values of the residue 
signals in a VOP (Video Object Plane) and find the min- 
imum number of bit N needed to represent this maxi- 15 
mum value in the binary format. N is the number of bit- 
planes for this Video Object Plane and is coded in the 
VOP header of the enhancement layer. Within each 8 x 
8 block represent every one of the 64 absolute values 
of the residue signal with N bits in the binary format and 20 
form N bit-planes. The bit-plane is defined as an array 
of 64 bits taking one from each absolute value of the 
residue of the same significant position. Starting from a 
bit-plane which have a highly statistical probability two 
dimensional symbols are formed of two components 25 

a) number of consecutive 0 before a 1 this is RUN 

b) whether there are any 1 *s left on this bit-plane e. 
g. end of plane EOP. 

30 

If a bit-plane after the most significant plane contains all 
zeros a special symbol or zero is formed to represent 
an all zero bit-plane. Two-dimensional VLC-tables are 
used to transform the planes to a code-word. In the bit- 
plane coding each bit-plane of the residual samples in 35 
a block are coded one after the other. 
[0010] Bit-planes of a sample which is seen in Fig. 3 
have the value 69. Bit 6 is the most significant bit and 
bit 0 is the less significant bit. Usually we say that the 
most significant bit is more important than the less sig- 40 
nificant bit. So usually the highest priority is given to the 
most significant bit MSB. Now we have to see the sta- 
tistical probability to have a 1 in the bit 6 plane for the 
whole video image point. The statistical probability is 
very low to get a 1 for the whole image. An analysis of 45 
some video sequences shows that when the MSB plane 
is missing, the visual degradation is not as high as pro- 
posed. Medium bits are more important, e.g. bit plane 2 
for our Fig. 3. So the sorting of the bit-planes can be 
done in a different way not starting with the most signif- so 
icant bit but with a bit-plane of high statistical value. One 
method to have a different sorting criteria is to compute 
the peak signal to noise ratio (PSNR) of the reconstruct- 
ed signal with a missing bitplane. So we get a statistical 
table that is built by the PSNR versus the bit-plane. The ss 
PSNR allows to sort the data in a specific way. From the 
less important PSNR to the most important PSNR very 
close values of this criteria cannot change the sorting 
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scheme. It is possible to define a specific threshold for 
changes in the criteria to change the sorting scheme. 
After the sorting of the bit-planes each bit-plane is con- 
verted into symbols and coded using the VLC tables. 
Based on their locations in the bit-planes different VLC 
tables are used for coding the code-words. The further 
procedures are known from the publication of MPEG 4 
"Coding of moving pictures and associated audio" Fig. 
4 shows an encoder which is able to realize the inven- 
tional method. First a discrete cos in us transformation 1 
is made by a special transformation means. The trans- 
formation means 1 is connected to a quantisizing means 
2 and the quantisizing means 2 is connected to a en- 
coder 3. The output of the encoder 3 is connected to the 
packatizer 4. The residual information of the transfor- 
mation 1 is fed into a inverse quantisizer 2a and an in- 
verse transformation 1a. The data stream of this trans- 
formation 1a is added to the original source stream to 
get the residual data stream. The residual data stream 
is transformed in a transformation 1 b and fed into a bit- 
plane coder 5. The output of the bit-plane coder is con- 
nected directly or over a entropy decoder 3a to the pack- 
atizer 4. 

[0011] In fig. 5 the bit-plane coder 5 includes means 
for bit-plane encoding of the absolute values of the res- 
idue signal 6 sorting means for sorting bit-planes 7 after 
a special sorting scheme, and means for detecting 8 a 
necessary change in the sorting scheme using fixed 
threshold values. The bit plane coder 5 can enclude an 
entropy decoder 3. 

[001 2] The coding method is working for video, audio 
and voicedata streams. For the sorting of the bftplanes 
other criteria then that describes in the preferred em- 
bodiment are possible. The criteria must be defined by 
the best system performance. 



Claims 

1. Method for coding residue data that are separated 
from a highly compressed base layer of data by tak- 
ing a reference from the original and reconstructed 
coefficients of a mathematical transformation of da- 
ta, using the residue signal with N bits in binary for- 
mat and form N brt-p lanes, characterized in that the 
bit planes are sorted by a defined criteria. 

2. Method for coding residue data that are separated 
from a highly compressed base layer of data by tak- 
ing a reference from the original and reconstructed 
coefficients of a mathematical transformation of da- 
ta, using the residue signal with N bits in binary for- 
mat and form N bit-planes, characterized in that the 
bit planes are sorted by the peak signal to noise ra- 
tio of the reconstructed signal with a missing bit- 
plane.. 

3. Method for coding according to claim 2, character- 
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ized in that the sorting of the bit-planes can be in- 
fluenced by a predefined figure. 

Method for coding according to claim 3, character- 
ized in that the predefined figure changes if the s 
changes in the statistically product over come a pre- 
defined threshold. 

Coder for coding a data stream including transfor- 
mation means 1, quantisizing means 2 and the io 
quantisizing means 2 are connected to a encoder 3 
encoding the data stream with a run length encod- 
ing and a variable length encoding, and connected 
o an output .with feeding residual information of the 
transformation 1 into a bit-plane coder 5 that is con- is 
nected to the output. 

Coder according to claim 5 including a bit plane cod- 
er 5 with means for bit-plane encoding of the abso- 
lute values of the residue signal 6, sorting means 20 
for sorting bit-planes 7 after a special sorting 
scheme, and means for detecting 8 a necessary 
change in the sorting scheme using fixed threshold 
values. 
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